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Abstract 

We study spin glasses with Kac type interaction potential for small but finite inverse 
interaction range 7. Using the theoretical setup of coupled replicas, through the replica 
method we argue that the probability of overlap profiles can be expressed for small 7 
through a large-deviation functional. This result is supported by rigorous arguments, 
showing that the large-deviation functional provides at least upper bounds for the prob- 
ability. Finally we analyze the rate function, in the vicinity of the critical point Tc = 1, 
/i = of mean field theory, and we study the free energy cost of overlap interfaces, 
assuming the validity of a gradient expansion for the rate functional. 

1 Introduction 

In recent times the introduction of interpolating techniques by Guerra pT, and their smart 
generalization by Talagrand [2\ to the case of two coupled replicas of the system, has led to 
the much awaited proof of the Parisi Ansatz [3^ for mean field spin glasses. The nature of the 
glassy phase of disordered systems in finite dimension remains on the other hand a largely open 
problem. 

The question is relevant both for the spin-glass problem, modeled by Hamiltonians with 
disordered two-body interactions, and for the structural glass problem, for which, despite the 

* e-mail: franz@ictp.trieste.it 
1^ e-mail: fltonine@ens-lyon.fr 
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absence of intrinsic quenched disorder, a phenomenological analogy has been suggested with the 
so called p-spin models, i.e., mean-field spin-glasses with p-spin {p > 2) random interactions. 

In both contexts, replica theory suggests that the mean field equilibrium phase diagram 
and the nature of the glassy phase should remain qualitatively unchanged above a finite critical 
dimension j3]. This description has been thwarted by phenomenological descriptions - droplet 
theories [S] - arguing that Replica Symmetry Breaking is unstable in any finite-dimensional 
space. Droplet theories have been comforted by mixtures of rigorous and heuristic arguments 
which, while clarifying specific aspects of finite-dimensional disordered systems, do not give a 
definite answer to the question of the validity of the mean field phase diagram in finite dimen- 
sion. In three-dimensional systems it is unlikely that the question can be solved experimentally 
or by numerical simulations. The dynamics of experimental spin glasses displays features such 
as a strong aging effect and a non-trivial fiuctuation-dissipation ratio [7] as predicted by 
mean field theory |H]. However, the observed dynamical regime is too far from the asymptotic 
situation that would allow to infer properties of the equilibrium phase |9j. In simulations, on 
the other hand, while dynamics suffers from the same problems as the experiments, the possi- 
bility of studying equilibrated samples is restricted to small systems and it cannot be excluded 
that the observed mean-field like behavior is dominated by finite-size effects. In this situation 
it is natural to look at models which, interpolating between mean field and finite range, allow 
for analytical treatment. The utility of such models would not be confined to the study of 
the equilibrium phase. Neglection of space in the mean-field dynamics of the p-spin model, 
for example, predicts an artifactual dynamical breaking of ergodicity that blocks the system to 
free-energy densities higher then the equilibrium one, realizing the scenario predicted by the 
idealized Mode-Coupling Theory for structural glasses PU]- The inclusion of finite-dimensional 
effects is necessary to study the dynamical processes that restore ergodicity allowing to go 
beyond Mode-Coupling Theory. 

In recent work llj, we showed that, considering spin glasses with variable range of interaction 
and taking the Kac limit of vanishing 7, one recovers the mean field free energy, thus 
generalizing the celebrated Lebowitz- Penrose theorem In addition to the free energy, the 
same convergence result applies to the local order parameter ^Hj- In other words, one can define 
a local overlap distribution function and show that this tends to the usual mean field overlap 
distribution function P{q), which is non-trivial in the low temperature regime. Of course, this 
has no direct implication on the phase structure for small but finite 7, where one can expect a 
transition only for high enough dimensionality d. One can hope however that the 7 = limit can 
be taken as a starting point to study the spin glass transition in a simplified setting. This hope 
is comforted by what happens in non-disordered systems, e.g., the ferromagnetic Ising model. In 
that case, through a block-spin transformation one can introduce spatial magnetization profiles 
and express their probability by means of a suitable free-energy functional J3] . This leads to a 
field theory over the magnetization profiles, which can be analyzed "semiclassically" , the role of 
the large parameter in front of the action being played by 7"*^. Thanks to that, customary low 
temperature techniques, of the kind of the Peierls argument or Pirogov-Sinai theory for Ising 
systems, can be adapted to prove the existence of a phase transition for small 7 in dimension 
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large enough [22] ■ 

In this paper we address the problem of achieving an analogous field-theoretical represen- 
tation for the spin glass problem. We consider a variant of the spin glass model with Kac 
interaction potential, the ultimate goal being that of studying the presence of long-range order 
for large but finite interaction range 7"^. We first give a definition of long-range order as sen- 
sitiveness in the bulk to appropriately chosen boundary conditions. We apply to our problem 
the method of coupled replicas jlHI and, as in [12], we consider two copies of the same system 
coupled in such a way to have local overlap fixed on the boundary. The appropriate field theory 
will then result from the evaluation of the free-energy cost for having overlap profiles on certain 
coarse-grained regions of space. In a first moment we resort to the replica method and use a 
generalization of the Parisi Ansatz suitable to study problems of coupled replicas [T3] , in order 
to evaluate the free-energy cost. Then, through the by now usual interpolating techniques [T7j . 
PP, PH] we prove that the replica expression provides a free-energy lower bound. 

Once the field-theoretical representation has been obtained, one can envisage to use it to 
prove the existence of long-range order in high enough dimension. A necessary preliminary 
task, which we undertake in the present work, consists in the analysis of the properties of the 
rate function and in the evaluation of the cost of overlap profiles. This functional has a zero 
mode corresponding to fiat profiles with overlap chosen in the support of the mean field P{q) 
function. This implies that the lowest cost interfaces separating regions with homogeneous 
different values of the overlap will be extended in space. 

Close to the critical point T = 1, h = oi mean-field theory, we give some interface 
estimates in the lines of ^], indicating that the cost for extended "overlap interfaces" grows 
with the linear dimension L of the system as L'^~^/'^ / j^/"^ . The main difficulty in inferring from 
this fact the presence of long-range order for d > 5/2 lies in the possible existence, that we 
cannot exclude, of entropic contributions scaling with higher powers of L, that would destroy 
the possibility of the phase transition for any 7 > 0. 



2 The model 

The Hamiltonian of the Kac spin glass with two-body interactions, on the (i-dimensional hy- 
percube A = {1, ■ ■ ■ , L}"^ and in presence of a magnetic field h, can be defined as 

H^ia, h;J) = — Jij(^i<^j - h^Ci. (1) 

i,jeA ieA 

The Jij are Gaussian independent random variables with zero mean and variance 

EJf^ = Y<P{l\^-j\), (2) 
where is a smooth non- negative function with support in |x| < 1, and normalized so that 

d'^x(j){\x\) = 1. (3) 
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We will also require (f) to be non- negative definite, i.e., 



j rf'^x0(|x|)e^^^ > for any k E W^. (4) 

In the theory of mean field spin glasses an important role is played by p-spin models where the 
spins are coupled through p-body interactions. It is interesting to generalize the definition of 
the Kac spin glass model to that case and define the Hamiltonian 

H^\a,h]J) = — ^ ^ Jn-v^i, ■ --(Tip - /i J^(Ti, (5) 



with 



Pfj2 N EfcgA^(7Ni-fe|)---^(7Kp-fe|) ..X 



and 



wi^) = j2mk\). (7) 

fceA 

where iIj{\x\), x E W^, is any non-negative summable function with compact support, normalized 

= 1. (8) 



fceA 



as 



The rationale for the choice © among all possible functions of p variables with range is 
discussed in and ensures that for all f3, h, A and for even p, the finite volume free-energy 
of the Kac model is bounded below by the mean field free-energy corresponding to the same 
external parameters and number of spins. Of course terms with different p can be combined. 
For these models we recently proved the convergence of the free energy to the mean field value 
in the Kac limit, provided that p is even, as well as the convergence of the distribution of the 
local order parameter |13j . 

For many purposes the analysis of the p-spin model is very similar to the one of the usual 
two-body Hamiltonian (P), while the notations for generic p are much heavier. For that reason 
we will present all our arguments in the case of the two-body model, and we will give at the 
end the general formulae in the p-spin case. 



3 Overlap profiles and boundary conditions 

At mean field level, the order parameter for the spin glass transition is the Parisi probability 
distribution, describing the statistics of the overlap between two replicas with the same disorder, 
induced by the Gibbs measure and by the disorder distribution. In Ref. jT3| we showed that 
in Kac spin glasses the distribution of local overlaps, on scales of the order of the interaction 
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range, tends to the Parisi overlap probability distribution for 7 — > 0, in any space dimension 
d. This does not tell anything about the possibility of long-range order where the probability 
distribution of the global overlap has a non-trivial shape. In order to discuss the possibility 
of long-range order, let us introduce the local overlaps, and the probability of local overlap 
profiles. First of all, let us partition 7/- into cubes Qk, k E if" ^ of side bj^ (to be chosen to be 
an integer): 

fifc = e Z'^ : -h <H< -{h + 1); / = !,..., d}. (9) 
7 7 

The situation we have in mind is 

(10) 

7 7 

and, for definiteness, one can think that 5 ~ 7^"^ for some < £ < 1. Let us denote by 
M = [L^) the total number of boxes. Given two spin configurations and cr^ on A we define 
the local overlaps on the box as 

7\ d 



and the global overlap 



^(^^^') = ^E^^' (12) 



• A 



Of course, as long as 5/7 is finite the local overlap can assume just a finite number of values. 
We define a "local overlap profile" {pk}k=i,- ,m to be a collection of possible values for the local 
overlaps^. Given a realization J of the disorder we define the Boltzmann weight associated to 
a local overlap profile {pk} as 

BhliPk}] J]=Y exp(-/3ifA(o-\ h] J) - l3Hf^{a'^, h; J))l{g,,(<xi,<72)=pfeVfe}- (13) 
For fixed disorder, the probability of an overlap profile is just 

^^f^^'^^' ^] - Z^{P,h;jr ^^^^ 

From the results of one can argue that the functional PA[{pk}', J] must be concentrated, in 
the situation (fTn|) . on profiles where each of the pk is in Supp{P{q)), the support of the mean 
field Parisi overlap distribution. The expectation from replica theory is that in high enough 

^The definition we give here does not coincide exactly with the one adopted in |13| . while its properties for 
small 7 do not depend on the details of the definition 
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dimension and 7 small enough, at temperatures smaller than = 1, long-range order should 
be present. The two- replica free energy would be dominated by configurations with a constant 
overlap in space, their weight being given by the function P{q). 

The space homogeneity of typical overlap profiles can be argued considering that in any fixed 
subset f2 C A containing an extensive number of spins a|A| the overlap probability function 
restricted to this set should, in the limit of large A, coincide with the one of the whole system. 
Considering then the total overlap between two configurations q = aq^ + (1 — a)q\_Q, it is 
clear that from the fact that and q\_Q are distributed like it follows that the product 
qnqA-n is also distributed like g^. Analogously for all r and s positive integers, q^q^^n must be 
distributed like g^"*"*, implying that P{qn\qA-n) = S{qn — qA-n), i-e. homogeneity of the overlap 
in space. ^ 

In order to detect the possibility of an ordering phase transitions one can then impose 
"overlap boundary conditions" in the two-replica system. Suppose to fix the overlaps pk to a 
given value p G Supp{P{q)) for all the flk belonging to a boundary region of thickness ~ 7"^ 
around the border, and to let otherwise free the boundary conditions. Long-range order would 
correspond to the fact that the probability of having a deviation of the local overlap from the 
value p, in a box situated in the bulk of the system, is vanishing for diverging box size. 

In the following, we will concentrate on estimates of 

FA[{Pk}] = -^E \ogB4{p,}; J], (15) 

which is the disorder-averaged free energy functional corresponding to B/^[{pk}; J], i.e., the free 
energy of two replicas with fixed overlap profile. We will see in the next sections that saddle 
point approximation can be used to obtain a small-7 expansion of the free energy functional. 

The rationale behind the definition (|TH|l is that we expect the fiuctuations of the probability 
PA[{Pk}', J] to be much smaller than its typical value, as long as Pa ~ exp(— aL^) for some 
a,/i > 0, so that the expectation of the logarithm gives its typical value^. Thanks to the the 
same self- averaging argument, it is reasonable to expect that the free energy of the two- replica 
system with fixed overlap boundary conditions can be obtained just considering the minimum 
of -FA[{pfc}] over all the overlap profiles pk satisfying the boundary conditions. This (unproven) 
self-averaging property will be implicitly assumed to hold in the rest of the paper. 

4 Replica analysis 

The free energy FA[{Pfc}] can be evaluated through the replica method for a system of con- 
strained copies, which shows in a natural way how -pA[{Pfc}] takes, in the large- volume and 

^We thank J. Kurchan for discussfons on this point. 

•^It is easy to see, by the means of the usual interpolation techniques, that the fluctuations of logP cannot 
be larger than 0{L'^^^), which implies the desired self-averaging property for those profiles such that /i > d/2. 
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small-7 limit, the form of a rate function in a large deviation problem. For the sake of brief- 
ness we will not reproduce the full calculations, and we will just indicate the main steps in 
the derivation and the final results. In the next section we will then prove that, modulo some 
error terms which we will estimate, the rate functional found via the replica method provides 
a rigorous free energy lower bound, as it happens in the case of the unconstrained model |I] . 

As usual, the replica method starts from the expression of E{B\[{pk}; J]") for integer 
n. Introducing the replicas cr['" for r = 1,2 and a = l,...,n and the local replica matrices 
Qm.sfe = ^I^ XlieCfe satisfying the symmetry conditions Q™'"** = Q^*'^" and such that 

the diagonal elements are fixed to Q]^'^"" = 1 and Q^"'^" = pk, the average of the n-th moment 
can be written as an integral over the elements Q™'** which are not fixed: 

EiB^[{p,};jr) = /pQexp^f-j J] <5'^</,(<5|fc - m|) ^ g^^^Q™'^'' 

W} 

This expression is simplified introducing a continuum notation. Let us rescale the system by a 
factor 7 and let x E V = [0, -^7]'^. Define then Q™'"** = Q™''*^ for x/7 G fi^ and write 

E{BA[{pk};Jr) = JvQexp{-f3F^^^^[Q,{pk}]) (16) 

^ f VQexp (-^ Yl [ d''xd%<l)i\x-y\)iQ:'^^''-Ql 

X exp f--^ / d''xF^]^^,[Q,,pS) (17) 
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where F^s/-yy ^^^^ energy functional which one finds, within the replica method, when 

one computes the free energy of two Sherrington-Kirkpatrick (SK) systems with {S/'yY spins, 
constrained to have a mutual overlap p^- Note that F*^"^ has just a local dependence on the 
"overlap matrix" Qx and on the overlap profile px- For large 5/7 a saddle point approximation 
can be considered and one needs an Ansatz for the matrix form in order to compute the 
n continuation. This has been considered in ITT)| EH] where the problem was treated 
assuming that each nxn matrix {Qx°'''^^}i<a,b<n, for fixed indexes r, s, has a Parisi-like structure 
PJ, and is therefore parametrized, in the limit n ^ 0, by a functional order parameter q^^i-) '■ 
[0, 1] — > [0, 1], verifying the symmetry q^^^iu) = q^^^iu) and the monotonicity condition that for 
< f < M < 1, the 2x2 matrix in the indexes r and s, {qx^{u) — ql:''{v)}i<r,s<2 are non-negative 
definite. One therefore needs to consider two families of functions qxiu) = ql'^{u) = q^'^iu) and 
Pxiu) = ql''^{u) = ql'^{u), with x & V and u G [0, 1]. 
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4.1 Analytic continuation 

In order to perform the analytic continuation of F^^^"^ as n — > 0, it is useful to define the 
convolution of the functions q^'^{u) with the interaction potential 



?TM= / d'y<l>{\x-y\)q;''{u), (18) 



V 



and the Lagrange multiplier associated to the constrained local overlaps p^- After some 
algebra one can write for the n — limit: 

- /?7'i^f '^Ife}, {q^i-)}, {e.}] = (21og2)|\/| - t j^d'x (^1 + pi - j'^ du {q.{uf + p.{uf)^ (19) 
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+^ / d''xd''ycl^{\x-y\)({P,-Pyf- I du[{q,{u)-qy{u)f + {p,{u)~py{u)y]] (20) 



/ d'^x {-e^px + log cosh(ea;) + 5'x(0, h, h; e^)) ,(21) 
Jv 



where gx{u,yi,y2; e^), with yi,y2 G M, u G [0,1], is the solution of the backward parabolic 
equation^ 



dg:, 1 ^ dq^^' ( d'^g^ , dg^ dg^ 



du 2^ du \dyrdy, dyr dy^ J 
with final conditions 

5'x(l, yi, y2\ ^x) = log [cosh(/5yi) cosh(/3?/2)] + log (1 + tanh(e^) tanh(/??/i) tanh(/??/2)) • (23) 

The functions q^'^i-) and ex are variational parameters over which one has to optimize to find 
the desired free energy ()15|1 as a function of the overlap profile. 

It is instructive to compare the Kac functional with the formula of the Parisi mean field 
free energy which, once optimized over g(.), gives the free energy per spin of the SK model: 

-/3^^'^--[g(.)] = log2 - ^ (^1 - duqiuY^ + /(O, h), (24) 
f{u, y) being the solution of 

df _ _idq(u) ( ay , / df^ ^ 



du 2 du \dy^~^'^ydyj I _ (^25) 

f{l,y) = log cosh(/3?/) 



''One often considers the case where the functions Qx^'i-) are piecewise constant. In this case, Eq. (|22() has 
to be interpreted correctly, see Sectional 
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4.2 The j9-spin case 

We give here without proof the expression of the Kac free-energy functional for the j9-spin 
model: 

- "^'"[fe}, {^k}] = 21og2|F| - ^^iE^l^d'^x, ■ ■ ■ d\^{x„ ■ ■ ■ 

X l+pxr--Pxp- du {qx,{u) ■ ■ ■ qxj,{u) + px,{u) ■ ■ ■ pxpiu)) 

L Jo ^ 

+ / d'^x {-e^px + log cosh(e^) + ^^(0, h, h; e^)) , (26) 
Jv 

where 

0(xi, ■ ■ ■ ,Xp) = / d'^kipdxi ~ k\) ■ ■ -ip^Xp- k\) 



and gx{u, 2/1,2/2; ^x) is the solution of the backward equation (|^. with (Q''{u) replaced by 

^ d'^X2 ■ ■ ■ d'^Xp (f){x, X2,-- - , Xp)ql''{u) ■ ■ ■ q^'fiu) 



2jv 

and with the same final condition ()23|1 . 

5 Interpolating estimates 

In this section show how the free energy functional (PT|) arises, without using the replica for- 
malism. We start by fixing more precisely notations and definitions. For any box VLk, let q]^^{u), 
r, s = 1, 2 be functions 

gr(.) : [0, 1] [0, 1] 

satisfying the following conditions: 

• symmetry: 

9fc ^(«) = 1k'^{u) = Qk{u), ql'\u) = ql'\u) = pk{u) (27) 

• boundary values: 

gr(0) = 0, gfc(l) = l, Pkil)=Pk (28) 

• positive definiteness: 

for any < v < u < 1 the matrix {ql''^{u) — ^'^^(f )}r.,s is non-negative definite. (29) 

Then, 
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Theorem 1. For any choice of {q^''^ {.)} k satisfying conditions (fF7|)-( f^) and for any {e^}, one 
has 



- PF^iiPk}] < -PF^^'iiPk}, {^k}] + 0(5)|A|. (30) 

One should keep in mind that 6 is the size of the boxes, in the rescaled units, which has to 
be thought of as very small. 

Remark We expect that also a lower bound of the type (jHUj) holds. To prove this, a suitable 
generalization of Talagrand's theorem |2] would be needed. 

Proof of Theorem^We introduce a generalization of the Aizenman, Sims and Starr's Ran- 
dom Overlap Structure juLfiJ, suitable to study a problem of two coupled replicas with spatially 
inhomogeneous structure. We introduce a set of possibly random weights > 0, where a takes 
values in a discrete set of indexes, such that 



and cavity fields /i""'*, k"''*, z G A, and s = 1, 2. The cavity fields are centered Gaussian random 
variables, independent of the couplings Jj^, with covariances 

E{hrhfn = 5,, S'mk - m\)q^'-^t^'^ (31) 

m=l 

E(fi:"'^/if'0 = (33) 



Ei^-^'^^n = ^ E mk-m\)qr-'^^^q'^'-'^^^, (32) 



k,m=l 



for i G Qk- We fix g^'^'"'^ = 5'^'^'"'^ = 1 and g^'^'"'^ = Pk, the constrained overlap in the box 
Qk, while all the other parameters are free (apart from the obvious constraint that the above 
covariance matrices are non-negative definite) and can be optimized to saturate the bounds. 
Notice that the cavity fields in different replicas are correlated. Define 



H^{a\a^) = VtE(/^A(a^/^ = 0; J) -k"'^) - v^T^ ^ /if 'X^ - /i ^ a. 



Za,t = ^a,t[{Pfc}] as the respective partition function with constrained overlap profile {pfc}, Zt 
as 

a 

and the interpolating free energy J-'t as 

-m = E\og ^;^;p''l^^ . (34) 
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For the t-derivative, one gets 
dt 4 



a,l3,r,s \i,j£A 

Here, denotes the Gibbs average, corresponding to the Hamiltonian H°{a^,a^), acting 

on the two rephcas cr^,(T^ with constrained overlap profile. On the other hand, tu^^^ is the 
duplicated Gibbs average, involving the four replicas a^'^, r,s = 1, 2, with Hamiltonian 

(o^ ' ) + (a ' ,cr ' ). 

Note that, in the average cu^^^, only the overlap profiles between replicas a^'^, a^'^ and between 
cr^'^, 0"^'^ are constrained to {pk}- Thanks to the constraints on the local overlap profile and to 
the choice for the covariances of the cavity fields, the first term in the derivative is at most of 
order 0(5) |A| (it is not exactly zero, since has small variations within each box). The second 
one gives 

(-yElZi' UpZ^.Z^.J^^Um-ml) (36) 

t a,f3,r,s k^m 

The average is negative since (p is non-negative definite by the assumption (^, so that we get 
the bound 

-PFA[{Pk}] = -PJ^i < -PJ'o + 0{S)\A\. (37) 

To complete the proof of Eq. (jHUj) . we have to show that there exists a choice of the C,a 
and of the cavity fields such that J-'q coincides with Fj^"''^[{pk}, {(lk^{-)}, {cfc}]- As usual, it is 
sufficient to consider the case where the functions q^^^i-) are piecewise constant, the general 
case being obtained as a limit. Let i^'>l,0 = mo<mi<---< mx = 1 and define 

= <ino] (38) 

Qk^'in) = qlj^'li + 1] for < u < m^+i (39) 
9^(1) = ^[^ + 1], (40) 
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where i = 0, - ■ ■ ,K are parameters satisfying the analog of conditions (P7j) - (j^ : 

?r[0] = 0, qk[K + 1] = 1, pk[K + l]=pk 

and 

{^fc'^M ~ Ik'^l^ ~ ^]}r,s non-negative definite. (41) 
If a = (ai, ■ ■ ■ , ax) with G N, we define the cavity fields as 

and 

/zr = ^(^'°'^)+z£i'^) + ---+z£f::^)^, (43) 

where the |/'s and the z's are centered Gaussian variables with covariances 



= ^ / d'xd'y<f>{\x - y\) {ql'^ii + l]ql'^[i + 1] - ql'^m/ 

^ JVxV 

and 

m 

for z G Vtk. This is equivalent to say that the parameters g^''*'^''' in (jHT|) - (jn^ are given by 

^a,s,/3,r ^ if = for a < £ and 7^ (46) 

Note that the covariance matrix of the 2;'s is well defined thanks to condition (PT|) . As for 
the variables ?/'s, the same is true thanks to Lemma Q in Appendix. As for the random weights 

we choose them as in [THI to be the Ruelle probabihty Cascade with K levels and parameters 
mi, • ■ ■ ,mK. 

At this point, using the properties of the Ruelle Probability Cascades (see for instance 
it is not difficult to compute explicitly JFq. For the denominator, one finds 



1' 



^ ) L Jo 

a k,m '- 



du [qk{u)qm{u) + Pk{u)Pm{u)] 



(47) 
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which, in the continuum notation, can be rewritten as 

^ l^d'x(^l+Pl- l^u {qA^^f + pAu?)'^ (48) 
/" d'^x d% ^{\x - y\) ( {p, - pyf - [ du[{q,{u)-qy{u)f + {p,{u)~py{u)f] 

^ JvxV \ Jo 

+0{6)\V\. 

As for the numerator of —f3J-'o, it is not difficult to see that it is bounded above by 



|A|21og2-7-M d^xe^p, 
Jv 

+ E log ^ n n [cosh(efc) cosh(/5/if + ph) cosh(/3/if '2 + ph) 

a k ia^l]^ 

+ sinh(efc) sinh(/?/i°'^ + ph) sinh(/?/if + ph)] , (49) 



where has the meaning of a Lagrange multiplier which implements the constraint qk{cr^, o"^) = 
Pk- The bound holds for any choice of {e^}, as it follows from the obvious inequality 

g- = ^ g-+efe(gfe{(Tl,a2)-pfe) ^ ^ ^...+efc(Qfc{al,<72)-pfc)_ ^gg-j 

Again using the properties of the Ruelle Cascades, the expression pHj) can be rewritten as 

(21og2 + 0(5))|A|+7-'^ / c/'^x(-e,.p, + logcosh(e,) + r7,.(0,/i,/i;e,)), (51) 

Jv 

where gx{u., hi,h2', e^) is the solution of the backward parabolic equation (j221); with final condi- 
tions (j2ni). □ 
At least when p is even. Theorem [T] can be immediately extended to the p-spin case. 

6 Analysis of the rate function 

The functionals (PT|) and (pUj) allow in principle to study the spin glass problem for small but 
finite 7. The difficulties one has to face in this respect are of two types. First of all, the 
analysis of the Kac functionals themselves is technically very involved, since for a given overlap 
profile one needs to consider a variational principle, whose solution cannot in general be found 
explicitly. On the other hand, the analysis of the Kac functional is not sufficient to infer the 
behavior of the probability of overlap profiles PA[{pk}', J]- Indeed, a careful analysis of the 
error terms due to finite-volume and finite-7 effects is also necessary, as it is already in the 
ferromagnetic case (22i| . 
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In order to overcome the first problem, in the present section we restrict to a situation (tem- 
perature close to the critical temperature of mean field theory and overlap profiles sufficiently 
smooth to apply a gradient expansion) where the Kac functionals can be reasonably replaced 
by an approximate form, which allows for an explicit treatment of the optimization problem. 
The mathematical justification of the approximations involved, together with the study of the 
error terms, is left to future research. 



6.1 Homogeneous solution 

In order to find the optimal estimate for the free energy FA[{pfe}] of the two-replica system 
with constrained overlap profile, one has to minimize the Kac functional (pT|l with respect to 
the Parisi functions ql:^{-) and to the Lagrange multipliers ex- The variational problem for 
coupled replicas has an evident degeneracy, at least in the case of overlap profiles constant 
in space. In fact, suppose to take all the pk equal to a value p in the support of the P{q) 
function for the single- replica problem. Then, if the Parisi function qpiu) solves the variational 
problem in the case of a single replica, i.e., if it minimizes the expression (j2H), the following 
position- independent form of the functions Qxiu) and Px{u) solves the two-replica variational 
problem: 

u < u/2 

Qxiu) = { p u/2 <u<u (52) 

u> u 




p.M=i"P (53) 

where u is defined as the value of u for which qpiu) = p. (It is immediate to verify that the 
definite positiveness condition ()29|1 is satisfied). At the same time, the variational equations 
with respect to are solved by ex = 0. It is then possible to see, comparing formulas and 
(j21I), that with this choice for the variational parameters q^:^ and ex, the Kac functional equals 
twice the free energy of the single-replica mean field system, and is therefore independent of 
p. Indeed, it is immediate to verify this property explicitly for the polynomial part ()48p of the 
free energy, which reduces to 



duqpiuYj. (54) 

As for the term ()5H) involving the parabolic equation, one can see that, if /f(w, y) is the solution 
of with q{u) = qp^u), the following form solves the equation (j22I) with the choice 

2/f(2m, yi)S{yi - ^2) u<u/2 
g{u,yi,y2) = { 2fF{u,yi)6{yi - u/2<u<u . (55) 

fF{u,yi) + fF{u,y2) u>u 
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Similar considerations show also that (j3T|) then equals twice the term one has in the free energy 
functional of the SK model. 

Notice that in the spin glass p = 2 case, where at low temperature the support of the 
function P{q) is an interval [qmin,(lmax], this degeneracy corresponds to the fact that the free 
energy of the two-replica system has a continuous zero mode (at least if finite-7 effects are 
neglected). In the p-spin case, on the other hand, the support at low temperature is given by 
two points {go, ^i}, and one has just a discrete degeneracy. 

In both cases the degeneracy reflects the fact that a constant overlap overlap profile, whose 
value lies in the support of the mean field distribution function P{q), cannot have too small 
a probability in typical samples, as it already follows from the results of ^3]- More precisely: 
the probability under consideration could be in principle exponentially small with the system 
size^, P ~ exp(— a(7)L'^), but in that case 0(7) has to vanish in the Kac limit 7—^0. 

6.2 The Parisi model close to Tc 

Since the analysis of the complete functionals is technically very involved, already at the mean 
field level it is customary to resort to simplifying approximations that, while representing 
correctly the physics in some limiting cases, allow for an analytic study of the saddle point 
equations. In the case of p = 2, where the mean field spin glass transition is of second order, 
close toT = Tc = l,h = one can use a Landau expansion in the order parameter, assuming 
that the Parisi function qriu) is close to zero for any m < 1. On the other hand for the p- 
spin case {p > 2), where the transition has a first order character with a discontinuous order 
parameter, one usually resorts to a spherical approximation of continuous spins with a global 
constraint. 

The scope of this section is to begin the study of the large deviation functional for the 
Kac spin glass with pair interactions close to the mean field critical temperature. For the SK 
model, the Landau expansion truncated to the fourth order is a good representation of the free 
energy of the model in the vicinity if the critical temperature, accurate to the fifth order in 
T = Tc — T. Parisi proposed pF to simplify the expansion, retaining among all the fourth 
order terms only the one responsible for replica symmetry breaking. It has been shown that 
this approximation does not affect the free energy to the fifth order in r. In the Kac model 
the Landau expansion can be supplemented by a gradient expansion, which corresponds to the 
assumption that all the functions appearing in ()21|) have small variations in space on scales 

■'This does certainly happen for instance in dimension 1, where there is no phase transition and the overlap 
is peaked at a single value as long as 7 is finite. 
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comparable to the interaction range 7 ^. The resuhing free energy can be written as: 



c 



j dx [(Ve,.)' - du {{VUn)f + (Vp.(w))^)] 
j dx[el- du {q.j,{uf + p.j,{uf)] 
+ j d'^x Q[2(g^)(g^.) + j du q^iu) j dv^q^iu) - qx{y)f + Q{pxqx){,{Px) - e^) 



+3 / duqxiu) j dv {pxiu) - px{y)f] 
Jo Jo 

W [ d'^x [ex - I du {qx{u) + px{u))] (56) 



where c = ^ / d'^x 0^^(|x|)x^, c* = [3^c and we have introduced the notation (■) = jj^ du ■ {u). 
In performing the expansion, we have assumed that qx{u) and Px{u) are of order r and we have 
subtracted an inessential constant factor, corresponding to the unconstrained free energy of the 
mean-field single-replica model. 

Instead of trying to justify the expansion (j56|) we will take it as a fait accompli and use it 
for our preliminary study of the rate function. Of course a full justification would involve the 
proof that the neglected terms are much smaller than the retained one. We expect this to be 
harmlessly true for T > T^, while care should be taken in the discussion of the case T < T^. 

6.2.1 T > 

In this section we discuss the interface problem for temperatures higher than T,,, i.e., for r < 0. 
In these conditions the mean field system is paramagnetic and for 7 — the only values 
of pk giving the same free energy as the unconstrained solution are given by = 0, and 
correspondingly quiu) = pkiu) = 0. We would like now to impose an overlap value pk = po in 
the boundary and study the decay of the overlap to zero in the bulk, and the free energy cost for 
the boundary conditions. For simplicity we will suppose that the overlap boundary conditions 
are imposed on a given d — 1 dimensional hyperplane, so that we can limit ourselves to a 
one-dimensional problem for the transverse direction. In other words, the boundary conditions 
will be pk = po for all k such that ki = 0, and periodic in the other directions. We will look 
for replica symmetric solutions to the saddle point equations (which amounts to assume that 
qk{u) = qk and Pk{u) = Pk are constant for < u < 1) and use a continuum limit formulation. 



16 



The reasons for the rephca-symmetric choice (apart from its simphcity) will be briefly discussed 
in the following. The one-dimensional free-energy density one obtains from (1^^) is then 

-Pl'f^"' = ^(5x.p.)^ + yP^ + ^4-p.e.-|R.6.0'-(9.^^^ 

- fx- Pi) + 3 [2gx + QPxQxiPx - e^)] 
+ l[4-qt-pt] + h'{e^-Px-qx). (57) 
"Equations of motion" are obtained by requiring the action to be stationary: 

c*d% + P% - e, = 

2 

cdle^ + e^-p^ + 2Te^ - 2p^q^ + -el + h'^ = 

2 

cdlq^ + 2rg^ - 2pl + 2p^e^ + -q^ + = Q 

cd% + 2tp, - Aq,p, + 2g,e, + '^pl + = 0. (58) 

The analysis of these equations for negative r is straightforward. As an illustration we discuss 
the case h = 0, the more general case being quite similar. For h = the equations admit a 
solution (jx = Px = and 

c*dlp, + (3^p, - e, = 

2 

cdle^ + - p^ + 2re^. + 3^ = (59) 

Since we are assuming that px = 0(r), the cubic term in (j59|l can be neglected to the leading 
order, and one has the solution 



Px = (^x= Poe 



which shows that the memory of the boundary condition is lost exponentially fast. Note that the 
solution is actually slowly varying, which means that the gradient expansion is self-consistent. 
Other solutions of exist (the boundary conditions for are not specified) but they are no 
longer slowly varying or diverge for x — 00. These have to be discarded, since in that case the 
approximations involved in ()56|) clearly break down. 

Inserting it in the free energy and integrating over space one finds 

-iii'Fi-'{p.\ = -vwiPiiiLr-' + o{pt/^/F\)iiLr-\ (61) 

which implies that the boundary conditions imposed require a surface free energy cost 



L 



AF ~ pI^/2c\t\. (62) 

7 

17 



for the imposed boundary conditions. Recall that this result has been obtained within a replica- 
symmetric Ansatz for the Parisi functions. Thanks to the variational character of Theorem Q 
this implies that the free energy cost for the chosen boundary condition is not smaller than 
flfi2|l . Note the appearance of a divergent length ^ ~ as the transition is approached. 

This is the mean field exponent for the correlation length, which does not take into account 
renormalization effects. 

6.2.2 T < 

The case T < is the relevant one to study the possibility of long-range order of Parisi type. 
Ideally one would like to prove (or disprove) the existence of a finite critical dimension die 
above which long-range order is present for small enough 7. As we stressed in the introduction, 
the issue can be formulated as a problem of sensitiveness to overlap boundary conditions for 
coupled-replica systems. The knowledge of the exact large deviation functional, the free-energy 
cost as a function of the overlap profile, would in principle allow to reduce this problem to 
the proof of the existence of a phase transition in a (non-random) field-theoretical model. Our 
Theorem n provides a lower bound to the large deviation functional, thus if we define d^^ as the 
lower critical dimension for the approximated theory, one can argue that die d*j^c^- order 
to study the stability of long-range order, one should identify the relevant excitations around 
the homogeneous solution ()52 |) - (j3nj) . that induce overlaps different from po in the center of the 
system, pQ G Supp{P{q)) being the chosen overlap boundary condition. In the following of this 
section we will argue that excitations localized in a region of size i have a free-energy cost of 
the order On the other hand, in analogy with the usual Peierls argument for the Ising 

model, one should also find a way to estimate the number of such excitations and show that 
the corresponding entropic gain does not overcome the free-energy cost at low enough 7. Let 
us for example imagine that the number of excitations grows with i as exp(c£'^~^). It is clear 
that if 6 = a, as it happens in models without disorder, then for 7 small enough and d > a large 
excitations will be exponentially suppressed and dj^^ = a. Conversely, if 6 < a the entropy 
terms will dominate for all d and destroy the phase transition for all finite 7. 

An equivalent method to determine long-range order makes use of "twisted" boundary 
conditions. In that case one direction is singled out and, while periodic conditions are assumed 
in the remaining directions, pi and p2 conditions are chosen at the boundaries along the preferred 
direction ^H] ■ Again, in a system of linear size L one can expect profiles with free-energy cost 
proportional to L'^~°-/'j°- and an entropy proportional to {^LY~^. 

The "energetic" contribution can be estimated for small 7 as the value of the large-deviation 
functional corresponding to the minimizing profile. The study of non-uniform saddle points of 
the free-energy ()56|1 corresponding to inhomogeneous boundary conditions to determine the 
cost for overlap interfaces have been first put forward in ^Hj- In that paper the saddle point 
procedure was assumed without further justification, while here it legitimated by the appearance 

^Of course, one should also show that the "error terms" 0{5) m Theorem are not dangerous 
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of the interaction volume 7"*^ in front of the action. The results of JH] can be mutuated directly 
to our case. 

In that paper it was assumed that the solution of the optimization problem could be obtained 
by a perturbation of the form (fH^ - (fH!^ . and it was found that the form should be 

modified for values of u around 'u/2 and u. Thanks to this modification, and translating in 
terms of the Kac model, the scaling of the free energy results to be of the order L'^~^/^/7^/^, 
thus modifying the values of the exponent a from 3 to 5/2. This again should be considered as 
a (better) upper bound estimation, and if we suppose that this is the exact value, we conclude 
as in that "energetic" effects destroy the possibility of Parisi order in dimension d = 1,2, 
while they are consistent with that kind of order in dimension 3 and above. 

We would like to conclude by remarking that a simple estimate making use of the "homoge- 
neous solution" does not apply to the p-spin model, and more generally to models with 
one-step RSB. In these cases the function qpiu) has the form qpiu) = 6{m — u)qQ + 6{u — m)qi 
and the support of P{q) is just the set {qo^qi}- There are only two homogeneous solutions 
of the kind corresponding to the two possible costless overlap values for p, go and 
qi. The analogous of the hypothesis of neglecting the kinetic contribution in the saddle point 
equations would consist in assuming in different points of space either one or the other possible 
form. But in this case, it is simple to realize that the kinetic term would be identically equal 
to zero. In order to get an estimate of the free-energy cost for an interface, a detailed solution 
of the space-dependent saddle point equations is necessary 

7 Conclusions 

The main result of this paper is the derivation of large deviation functional, quantifying for 
small 7 the probability of overlap profiles in spin glass models with Kac-type interactions. We 
obtain that the replica expression provides a lower bound to the true free-energy functional. 
Moreover, putting aside the problem of mathematically justifying the approximations involved, 
we performed a first analysis of the free-energy functional, finding estimates for the free-energy 
cost of extended "overlap interfaces" . 

In this paper we have considered the case of two replicas coupled in a symmetric way. Al- 
though we did not discuss it, the generahzation of our analysis to R replicas, which can be useful 
to discuss issues related to ultrametricity ^Hl; can be achieved in a rather straightforward way. 
Another possible and more interesting generalization concerns the introduction of a "quenched 
potential" where again one considers two replicas, but coupled in an asymmetric way. One 
considers a first replica in an arbitrary configuration chosen with the usual Boltzmann weight, 
and then a second one, constrained to have a given overlap profile with the first PU]. This 
approach, more involved than the one presented here, would be especially relevant for the case 
of the p-spin model, where one would like to study nucleation of entropic droplets in a given 
equilibrium state |25| l26]. 
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A Covariance of the cavity fields '^^ 



Let i = 0, - ■ ■ ,K, r = 1,2, and 



= I 7C ") I • (63) 



The positive-definiteness of the covariance of the variables ya'^^ in Section El follows from the 
following Lemma: 

Lemma 1. Assume that i=l,--- ,K, r = 1,2 are non-negative definite. Then, 

the same holds for Bi — Bi-i, where 

ft _ / o'A' o-'-Swo-^Sm \ . 

Proof of Lemma Q From the hypothesis follows that 

aSW±ag(£)>0 (65) 
aS;) ± aSJ > 0, (66) 

where A^^J = cLcJ i^)~^cd The statement of the Lemma is equivalent to the non-negativity 

of 

w«S? w - - - 1)] ± [«S w«S? w - - - 1)], (67) 

which follows immediately from Eqs. ()65|) - (jM)) . once ()67|) is rewritten as 

(aW + Aa))^SM|£tW + ,A<;) - ^^flm^ (68) 



, . .(2)^ a'n(<'-l)±«'i'2'(<'-l) , ,.(2) ,|2), a'n'(<-l)Ta'i2'(<-l) 

"rl^ll + ^12 J o +1^11 ^12 J o 



□ 



20 



References 

[1] F. Guerra, Commun. Math. Phys. 233, 1-12 (2003). 
[2] M. Talagrand, Ann. Math., to appear. 

[3] M. Mezard, G. Parisi and M. A. Virasoro, Spin glass theory and beyond, World Scientific, 
Singapore (1987). 

[4] C. De Dominicis, I. Kondor and T. Temesvari, in Spin Glasses and Random Fields A. P. 
Young ed. (World Scientific, Singapore 1998), for a recent application see: C. De Dominicis, 
I. Giardina, E. Marinari, O.C. Martin and F. Zuliani, preprint con d-mat/ 408088 

[5] D. S. Fisher, D. A. Huse, Phys. Rev. Lett. 56, 1601 (1986), A.J. Bray and M.A. Moore, 
in Heidelberg Colloquium on Glassy Dynamics eds. J.L. Van Hemmen and I. Morgenstern, 
Springer- Verlag (1986) p. 121. 

[6] see e.g. P. Norblad and P. Svendlindh in A. P. Young (ed.). Spin Glasses and Random 
Fields (World Scientific, Singapore, 1997) and references therein. 

[7] D. Herisson and M. Ocio, Phys. Rev. Lett. 88, 257202 (2002). 

[8] see e.g. J. -P. Bouchaud, L. Cugliandolo, M. Mezard and J. Kurchan in A. P. Young (ed.). 
Spin Glasses and Random Fields (World Scientific, Singapore, 1997). 

[9] S. Franz, M. Mezard, G. Parisi, L. Peliti Phys. Rev. Lett. 81 1758-61 (1998); 
J. Stat. Phys. 97, 459 (1999). 

[10] W. Gotze and L. Sjogren, Rep. Prog. Phys. 55, 241 (1992). 

[11] S. Franz, F. L. Toninelh, Phys. Rev. Lett. 92, 030602 (2004). 

[12] J. L. Lebowitz, O. Penrose, J. Math. Phys. 7 (1), 98-113 (1966). 

[13] S. Franz, F. L. Toninelh, J. Phys. A 37, 7433-7446 (2004). 

[14] G. Alberti, G. Bellettini, M. Cassandro, E. Presutti, J. Stat. Phys. 82, 743-796 (1996). 

[15] S. Franz, G. Parisi, M. A. Virasoro, J. Phys. (France), 2, 1869 (1993). 

[16] S. Franz, G. Parisi, M. A. Virasoro, Europhys. Lett. 22 (6), 405 (1993). 

[17] F. Guerra, F. L. Toninelh, Commun. Math. Phys. 230 (1), 71-79 (2002). 

[18] M. Aizenman, R. Sims, S. L. Starr, Phys. Rev. B 68, 214403 (2003). 

[19] S. Franz, G. Parisi, M. A. Virasoro, J. Phys. I (France) 4, 1657-67 (1994). 



21 



[20] S. Franz, G. Parisi, J. Phys. I (France) 5, 1401 (1995). 

[21] M. Talagrand, Spin Glasses: A Challenge for Mathematicians Cavity and Mean Field 
Models, Springer Verlag, Berlin (2003). 

[22] M. Cassandro, E. Presutti, Markov Proc. Rel. Fields 2, 241-262 (1996). 

[23] G. Parisi, J. Phys. A 13, 1101 (1980). 

[24] G. Bianconi and S. Franz, work in progress. 

[25] T. Kirkpatrick, P. Wolynes, Phys. Rev. B 36 8552 (1987). 

[26] G. Biroh and J.-P. Bouchaud, .cond-mat/0406317] 



22 



